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ABSTRACT 

A study examined the influence of discussion 
questions with a dual focus on important and implied text ideas in 
child- i»s story understanding. Subjects, 106 third-grade childreu 
from 2 middle-sized Illinois cities were randomly assigned to 4 
experimental groups and 1 control group. Their comprehension was 
measured with free and probed story recall after a 3-weelc unit of 
instruction in which questions focused on prediction or review were 
asJced. in the experimental groups while control group questions came 
from the basal series* teacher manuals containing the experimental 
stories. Results of mixed hierarchical analyses indicated that 
justifying answers significantly improved the performance of groups 
asked prediction questions but not groups asked review questions. ' 
Results also indicated a nonsignificant trend toward superior 
performance of the experimental groups over the control group, 
suggesting that importance and explicitness of ideas are appropriate 
foci in designing discussion questions. (Twelve tcibles of data are 
included; 71 references are attached.) (Author/RS) 
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Abstract 

This researdi examined the influence of discussion quesdons with a dual focus on important and 
implied text ideas in children's story understanding. In a three-week instrucdonal study, quesdons with 
such a focus formed the ba^ of the treatment for the four eiq^erimeiital groups, whUe control group 
quesdons came from the basal series teachers' manuals contaimng the experimental stories. Quesdons 
for each experimental group differed in focus (predicdon or review) and in ^diether they required 
answer justificadon* Comprehendon of 106 third-grade children randomly as^gned to the five groups 
was measured with free and probed story recalls. Results of mixed Uerarchical analyses indicated that 
justifying answers significantly improved the performance of groups asked predicdon quesdons but not 
groups asked review quesdons. lliei^e was also a nonsignificant trend toward superior performance of 
the e3q)erimental groups over the control group, suggesting that importance and inexplidtness of ideas 
are appropriate fod in dedgning discus^on quesdons. 
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HOW DISCUSSION QUESTIONS INFLUENCE 
CHILDREN'S STORY UNDERSTANDING 



^en Frank Smith (1975, p. 34) called comprehension "the condition of having one's cognitive 
questions answered," he was using questions as a generic term for a ^ole set of activities and 
CQgniti(ms that sidlled readers seem to engage in*-predicting» reviewing^ making inferences, and 
modi^ng interpretations, to name a few* Many researchers and practitioners, in fact, seem to view 
teachers* questions as a means of modeling and enga^g children in various active processes that a 
skilled reader carries out independently to make meaning while reading. The key to making questions 
useful in that way may be asking systematical)^ derived and strategically placed questions whose 
purpose and pattern eventual^ might be internalized by children-because, after all, the ultimate goal 
Of comprehenrion instruction is student independence in reading, not ^ving answers to teacher-posed 
questions. The present study is an attempt to integrate two Imes <^ research about comprehen^on 
instruction to de^se a method of generating and askbg discussion questions about complex stories. 
The purpose is to study the role of discussion questions with a dual focus on important and implied text 
ideas in children's comprehendon of discussed stories and stories that they read independently. 

Related Literature 

The present study fits into a body of research about the nature of text and teacher questions and their 
effects on comprehension that has grown considerably, especially in the last decade. Classroom 
observations of comprehen^on instruction (Durkin, 1978-79; Guszsk, 1967; Mason & Osbom, 1982; 
Morrison, 1986) and analyses of the instructional suggestions in basal reader teachers' manuals (Beck, 
McKeown, McCaslin, & Burkes, 197^ Durkin, 1981) have documented the preponderance of story 
questions; tiie emphasis tiiey place on low-level, Actual information v^e fsuling to develop plot or 
event sequences through lines of questions about stories; and the tendency to ask questions that may 
distract readers from a stor/s central content. 

Such descriptions of the state of classroom comprehension instruction have spurred a number of 
investigations into the changes in instruction that might lead to more desirable learning outcomes. 
Consistent witii current views of reading as a schema-theoretic process (eg., Adams & Collins, 1979; 
Anderson & Pearson, 1984; Rumelhart, 1977, 1980), these mvestigatioLS highlighted the role of 
background kno^edge in comprehension-both in its role of providing a prototypical organizing 
framework, a story schema for example, that enables readers to anticipate and organize text ideas (e.g., 
Fib^erald, 1984; Htzgerald/Whaley, 1981; Stein & Glenn, 1979), and m its contribution of tiie raw 
material out of which crucial story inferences can be made (eg., Paris & Lindaeur, 1976; Pearson, 
Hansen, & Gordon, 1979). >^th respect to the role of questions, most notsd)le are two general 
findmgs: (a) both training and practice in answering inference questions c^n improve not only 
children's ability to answer inference questions but also their general understanding of v^at they read 
(Gordon & Pearson, 1983; Hansen, 1981; Hansen & Pea.'son, 1983; Raphael & McKinney, 1983; 
Raphael & Pearson, 1985; Raphael & Wonnacott, 1985; Redfield & Rousseau, 1981; Sundbye, 1987); 
and (b) attention (through questions or otherwise) to the typical structure of stories (e.g., Htzgerald & 
Spiegel, 1983; Gordon & Pearson, 1983; Idol, 1987; Singer ^ Donlan, 1982) or to tiie information 
otiierwise identified as central or important in stories (Beck, Omanson, & McKeown, 1982; Omanson, 
Beck, Voss, & McKeown, 1984) can improve comprehension. 

The present study addresses several gaps in our knowledge about the role of story discussion questions 
in comprehension instruction: (a) the lack of integration between our knowledge about the structure of 
stories and our knowledge about inferential reading comprehension; (b) our incomplete knowledge 
about the effectiveness of a special class of inference questions, those that require predictions; and (c) 
our failure to test systematically the common*sensc notion that it is beneficial for children to justify 
their answers to discussion questions with evidence from the text or their background knowledge. 
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These issues are important in planning effective text-based instruction that centers on discussion 
questions* 

First, although the value of both central or important story questions and inferential questions has been 
documented, the relationship between the two has not been investigated Even in stories for young 
children, what is stated in the surface structure usually ^ves only a partial account of the complex 
relationships one must recognize to understand and appredate the story. For example, characters' 
goals, the relationship between their goals and their actions, and the conflict between two or more 
characters' goals often are ieit to inference, although they provide the locus ot causality in stories 
(Bruce, 1980a, 198(N>, 1984; Bruce & Newman, 1978). Yet it is not dear how any of the most prevalent 
story structure theoliesYcpresent inferences or account for their rde in the comprehension of complex 
narratives. Furthermore, a dose look at the questions in the redesigned story lessons of Beck and her 
associates (Beck et aL, 198^ Omanson et al^ 1984) shows that ^^lile all questions tapped central story 
content, less than one-third required inferring even the most straightforward connections between 
different sentences, and only half oi those required integration of information in noncontiguous 
sentences or integration of text information with background kno^edge. The general approach to 
potential^ difficult text ideas in the work of Beck et aL (1982) seems to be to suppty the difficult ideas 
(e.g«, that raccoons, because of their masks, might look a little like bandits) instead of leading children 
to figure them out through question:: and discussion. 

On the other hand, it is not dear how theories of inferential reading comprehension explain which 
inferences, out of the almost limitless number that could be generated about a complex story, are the 
most important ones for story comprehension. Trabasso and his colleagues (Nicholas & Trabasso, 
1980; Omanson, 198% Trabasso & hHchoIas, 1980; Trabasso, Secco, & Van Den Broek, 1984; Warren, 
Nicholas, & Trabasso, 1979) suggest that out of all the inferences that could be made v/bSlt reading a 
story, the ones most critical are those necessary for the comprehen^on of an event duun in a narrative. 
The degree to ^ch inference instructional studies have focused cn such inferences is undear. In 
Hansen^s (1981; Hansen & Pearson, 1983) studies, for example, important text ideas were the ba^ for 
inferences in the group taught an inference-making strategy, but ovly a strategy for vAiai Warren et al. 
c^ slot-filling inferences was taught The training strategy for maldng inferences was based on 
selecting important text ideas, then having students predict what would happen in the story from their 
prior experience in similar situations. For Hansen's inference question-only group (the group that 
practiced answering a lot of inference questions), it is not dear whether any inferences required ^^t 
Warren et aL (1979) call text connecting nor whether the inference questions tapped important text 
ideas. Gordon and Pearson (1983) and Raphael and her colleagues (Raphael & McKhmey, 1983; 
Raphael & Pearson, 1985; Raphael & Wonnacott, 1985) taught strategies for making both text- 
connecting and slot-filling inferences, but it is unclear what role importance played in the selection of 
examples for instruction or in the construction of inference questions. 

Besides this key issue of no research with a combined focus on importance and explidtness of the story 
ideas that are targeted with questions, the present research also addresses the issue that no studies 
have investigated the relative effects on comprehension of re\aew and discussion questions. Although 
predicting is a characteristic of good readers (e.g^ Collms, Brown, & Larldn, 198(^, Fitzgerald, 1984; 
Fitzgerald/Whaley, 1981), a spedal case of inference-n.aking (Pearson & Johnson, 1978), and an 
especially active and independeut form ot engagement with the text (e^ Stauffer, 1975), few 
investigators have involved children in prediction through questions. The successful strategies of 
Hansen (1981; Hansen & Pearson, 1983) and Palincsar and Brown (1984) incorporated prediction. 
Furthermore, recent work by Anderson and his assodates (Anderson, V^^lkinson, Mason, & Shirey, 
1987; Wilkinson, Anderson, & Wilson, 1987) showed thac prediction questions produced better 
memory for stories than did word-level questions when each was asked exdusivefy throughout small- 
group reading lessons. However, neither these investigators nor any others have carried out the more 
stringent test of comparing prediction and revaew questions that tap the same important story ideas. 
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Finalfyy no i:esearcli attention has been devoted to the value of having children justify theur answers to 
questioiis with evidence from the text and from background kno^edge. Although this practice 
frequciiiitly is idvi^cated in readmg metfiods textbooks (eg.. Mason & Au, 1986; Stauffer, 1975), it is 
supported at inre^nt onj^ by conventional ^^om. Giving evidence for answers seems to be a useful 
way to en^e^duldren in reviewing and integrating text information and background kno^edge, 
notidng and revidng any incorrect or implausible answers, and making thought processes public, but 
no studies have compart the performance of children required to justify their answers with children 
who are not required to justify Uieir answers* 

Overview of the Present Studty 
and Hypothesized Outcomes 

A logical step in this line of research, then, was to select stories that require making text*connecting 
and slpt*filling inferences for comprehension of the central story information, and to examine the 
eflPects on comprehen^cn of several manipulations of discusdon questions. In the present study, 
questions for each e^qperimental group placed spedal empha^ on making the important inferences 
necessary for understanding the stores central event sequence as defncted a map of the story 
(derived from a comtnnation of methods of representing story information). Story v-^mprehension of 
children in these experimental groups was compared mth the comprehension of children v^o were 
asked'story discussion questions suggested in basal reader teachers' manuals* Finer differences in the 
instruction of the four experimental groups reflected three related questions of instructional mterest: 
whether prediction and review questions have diflerential effects on story comprehension, i^ether 
consistentfy justif^ng answers has a more positive effect on comprehension than not justifying answers, 
and Aether the relative effect of justifying aaswers is mediated by i^ether questions require 
prediction or review of story ideas. Table 1 summarizes this description of the differences among 
groups in the study. 

[Insert Table 1 about herej 

Story comprehension was measured before, during, and immediately after a three-week instructional 
stu^. Lesson comprehension measures included oral free and probed recall of the stories read and 
discussed on the 4th, 8th and 12th days of instruction. Pretest and transfer measures included oral free 
and probed recall of stories read independently without discussion questions. Free recalls were scored 
for recall of important and unimportant explicitly stated story propositions and for plausible inferences. 
Probed recalls included literal, inferential, and thematic/story extension questions. 

The following group differences were hypothesized: 

1. The four groups w.ho were asked story map-derived questions were expected to 
perform better thaii the group asked basal reader questions on free recall of 
important literal information, generation of plausible inferences in free recall, 
and all probed recall questions-literal, inferential, and thematic/story extension. 

. The reasonmg behind this hypothesis was that discussion questions derived from a story map, because 
they came from an examination of the story's structure and degree of explidtness, would highlight 
important story information, follow the story's sequence, and encourage deeper processing (e.g., Craik 
& Lockhart, 197:^ Jacoby, Craik, & Begg, 1979; Glover, Bnming, & Plake, 1982; Glover, Plake, 
Roberts, 2Snmier, & Pahnere, 1^1; Glover, Plake, & Zmimer, 1982) through spedal emphasis on 
maldng important inferences^ Although thematic/story extension questions were not a spedal focus in 
story discusions, it was reasoned thai deeper processing would encourage richer elaborations that 
woidd lead to a greater likelihood of producing plausible answers to these questions. 

Z The two groups required to justify their answers during discussions '7ere 
expected to perform better than the two groups not required to justify theii 
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answers on the same measures-important literal recall, plausible inferences in 
recall, and all probe questions. 

The reasonmg behind this hypothec was that answer justification would serve to increase interaction 
with both literal and inferential story information, fadlitate revi^ng of incorrect or implau^le 
answers, and encourage students to examme the thought processes that led them to their answers. 
Agam, although thematic and story exten^on questions were not the focus of instruction, it was 
reasoned that deeper procesdng and exammation of thought processes would enhance the elaborations 
that would produce more plausible answers to these questions. 

3. No hypothesis was made about the overall effectiveness of prediction versus 
re>dew questions, because it was believed that under certam conditions 
prediction alone, without justing or verifyi^ig answers, could be ineffective. If 
students spontaneously reason through their predictions, incorporate text ideas 
into then- hypotheses, and reconsider their predictions after further reading, they 
may outperform students w^o are asked rtvicw questions. However^ if available 
story information is not used to form reasoned predictions, and if predictions 
that do not match story outcomes are not revised after further rea^ng, students 
might remember what they predicted rather than Vfbat actually happened in the 
story, with detrimental effects on all recall measures. Therefore, v^ther there 
is a net effect for prediction over review was expected to depend largely on 
whether students monitor their predictions spontaneously in the predict-only 
group. 

Method 

Subjects 

Data were collected m two phases to obtain a statistically adequate sample size in each of the five 
treatment groups. A total of 106 third-grade children participated in the study, 58 in Phase 1 
(February-March 1986) and 48 in Phase 2 (April-May 19^. The three schools involved (one with 
three third-grade classes in Phase 1, two with one third-grade class each in Phase 2) were from two 
middle-sized Illinois dties. The ori^al plan was to block students oc their standardized reading 
comprehension test scores and then randomly assign one student from each block to each of the five 
treatment groups, but practical constraints necessitated some deviation from this plan. 

First, the stipulation was added that no children were assigned to a treatment group that met during 
the tune their regular classroom reading group normally met with the teacher or any time slot during 
which they normally attended a spedal pull-out class. Second, smce Phase 2 was conducted in two 
separate schools, two treatment groups were run in one school and three in the other. Finally, a 
schedule change forced one child in the Phase I predict-plus-justify group to switch to the re\iew-plus- 
justify group after oniy nne day of instruction; and after one week of instruction in Phase I, two 
children m the review-only ^oup dropped out of the study so they would not miss a new computer 
class. 

The total number of students in each of the instructionaj groups across both phases of the study thus 
ranged from 19 to 24. The grand total of 106 children represents all but eight available children aaoss 
the two phases of the study: two from Phase I who did not have parental permission to partidpate, two 
from Phase I vfho dropped out, and three from Phase I and one from Phase 2 v/hocc achievement test 
scores and teachers* judgment suggested that they would be frustrated by the instructional materials. 
Table 2 shows the number of children and the average total reading pera^ttile per group in each 
school. 

[Insert Table 2 about here.] 
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Instructional Materials 

The same nine stories, chosen from third- and third/fourth- grade level basal readers not used in the 
participating schools, served as the basis for the 12 lessons m each group. Differences among group 
treatments were in the way the stories were di\dded into silent reading units-segments of the text that 
children read and discussed before further silent reading-and m the discus^on questions asked before 
or after each silent reading unit 

Stories. AH of the stories were structured around a problem-solving schema-in other words, each was 
based around a problem that a character tried to solve or interacting problems that several characters 
tried to solve. In addition, all required making text*connecting or slot-filling inferences for 
understanding some categories of story information, and all were either 500-800 or 1,000*1,600 words 
in length so they could be r^d and discussed in either one or two 30-minute sessions. Stories mduded 
realistic and fanidhil tales, both humorous and serious, both folktales and other genres. 

Stoiy maps. Generation of discussion questions that tapped important story content depended on 
creating a map of each story that represented the important literal and inferential story iniformation. 
The mvestigator devised a procedure for representing the relatively long and complex stories used in 
this study that made use of ensting story grammar and causal chain representations that had been 
applied to simpler stories (e.g*, Stdn & Glenn, 1979; Trabasso et aL, 1984). Briefty, e)qplicitly stated 
story information was divided mto story categories typically used in story grammar malysi&-^etdng(s) 
plus episodes, each of which might mclude an initiating events which set up a problem one of ttie 
characters had to solve; the goal of this character; one or more plans or attempts the character makes 
to solve the problem; and the result(s) of and reaction(s) to each attempt. Because the stories were 
long and often complex, not^every story proposition was mapped*-for example, neither details that 
could be subsumed under a mbre mdusive term nor information that did not advance the main story 
line represented by the problem-solution framework was mapped. 

Second, categories of information that were not stated expfidtly in the text, or that were disdosed out 
of sequential order m the story, were filled m and marked as inferences. Implied causal connections 
between categories of information ^ilarly were filled m and marked as inferences. Potential sources 
of comprehension difficulty thus could be located and targeted with questions later. 

For example, a story called *The Birthday" (Hart, 1977) concerns a named Delilah viho is almost 10 
years old (setting) who knows exactly what she wants for her birthday, but can't tell her parents 
because if she does it vnU not be a surprise, and her parents love surprises (initiatmg event of Episode 
1). The story continues. 

At dinner that night, she dropped a hint. 

''We're studying how sound works,** she said. "We learned how you get sound 

out of a record player. It's very, very mteresting.** 
'^I^ow?'* her father asked. 
Delilah told him. (Plan 1 of Episode 1) 

You're right,** he said. That's very, very interesting.** (Result 1 of Episode 1) (Hart, 1977, p. 
62). 

Several mapping conventions can be illustrated with this excerpt from the story. Hrst, m the first 
paragraph of the story, besides the information ithat Delilah is almost 10 years old, the story lists srx 
extraneous facts about Delilah (e.g., **She's the tallest girl m her class. She plays basketball and 
drums.**) that are not mapped because they do not advance the main story line. Second, the story does 
not expUdtly state here or elsewhere that what Delilah wants for her burthday is a record player. The 
reader must infer this from hints Delilah drops in various plan sequences throughout the story. This 
inference is an important one if the reader is to understand Delilsdi's surprise at the end of the story 
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^yAcn she receives a puppy instead of a record player for her birthday. Thns, in the story map 
representation, it woidd be listed as part of Delilah's goal and would be marked as an inference. 
Finalfy, it is tniiy in this iGrst plan sequence that Delilah's hint is e3q>Ucitly signalled (with the words Wt 
dinner that night, she dropped a hint.")» In the rest of the litoiy, the reader must infer her motivation in 
doing things like stopping m a department store to look throuf^ the record bins ^en she goes 
shopping with her parents, asldng her father i^at his favorite kind of music is in the car on the way 
home, and informing her mother that she has borrowed a record from the library and is going over to 
her friend's house to listen to it A further complexity of this story is that the parents' thoughts are left 
entirely to inference. The reader is left to dedde, later in Episode 2, whether Delilah's parents 
consciously elect to get her a gift other than the one die hinted for, or v^ether they simply fail to ^'get'* 
the hmts she gives in Episode t 

Silent reading units. The resulting map for each story first was used to divide the story into silent 
reading units-places ^Axcrc it would m^^^e sense to stop readmg and monitor OMnprehension, v^ch 
was accomplished in this sfiidy with discussion questions. The decision to ask questions during story 
reading rather than mass them at the end of the story refleds the present stud/s goal of modelhig for 
young readers what it is that sldlled readers do to achieve understanding. Skilled readers probably do 
not wait until they have finished reading a ^ole story to dedde whether they have understood it; 
rather, they probably monitor their understanding in the course of reading. The logic belund exactly 
where the ^ent reading unit boundaries were placed was based partly on the story map and partly on 
whether prediction or review questions were to be asked. 

Silent readmg units for the two review question groups ended where some sort of resolution had been 
reached about part of the story. These breaks sometimes occuned at the ends of episode sometimes 
where an embedded episode began, and sometimes in multiple-plan episodes after the character tried 
one plan and before he or she tried another. Logical breaks for the two groups being asked prediction 
questions were places m the story i^ere students had enough mformation to make reasoned guesses 
about what was going to happen next, but before closure was reached. These places might be during 
the initiating event, before ^e problem was stated; after the goal, before the plan was stated; after the 
plan, 'before the result was dear, after the result, before the character's reaction was dear; between 
plan sequences m an episode; between episodes; or at the end of the story. 

For example, \ the story The Birthday," the first silent reading unit for prediction groups ended after 
the mitiatbg event was described-^thus, children predicted how Delilah niight solve her problem before 
reading about any of her plans. Review groups, however, read all thrc ; of the plans that Delilah 
believed had been unsuccessful before enga^ng in any discussion. For the basal reader control group, 
the silent reading units suggested in the teacher's manual were used. 

Each child m each group read from a spcdally prepared copy of the story that contained only one of 
their group's silent readmg units per page, with the word STOP written at the end of the silent readmg 
unit. Students m each group typically read 250-300 words in each silent reading unit, after v^ch the 
investigator asked the discussion questions appropriate for the group. 

Discussion questions. Discussion questions for each experimental group were based on two 
interrelated considerations-centrality and mexplicitness of text ideas. Empha^ was placed on asking 
questions that tapped central story information that also had to be inferred. Questions for the review 
groups recapitulated the important information in a ^ven silent readmg unit and int^ated it with 
previously read information. Questions could be asked about the literal information needed to make 
important inferences; about missing categories of information, particularly if the character's goal was 
unstated; about implied connections between different categories of information; and about implied 
connections between episodes. 

Questions for the prediction groups required predicting upcommg important information that the 
reader could make reasoned guesses about at that point in the story. Questions were designed so that 
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for the most part, the information the re\aew groups used for their answers was the same information 
that the prediction f cups were making hypotheses about 

Members of the review-plus-justify group also e^^lained how they arrived at their answers using 
background knowledge and available text information* Members of the predict-plus-justify group, in 
addition to justify their answers in this way, also compared their pre<Uctions to actual ;ext events 
after further reading. 

A control set of questions from each story came from the basal reader teacher's manual 

The same excerpt from The Birthday" that has been discussed already ynH be used to illustrate the 
types of discusdon questions asked in each group. Review groups were asked the following questions 
about the part of the stoiy described above: 

1. What does Delilah want for her birthday? 

Z Why couldn't she tell her parents exactly vAiaX she wanted for her birthday? 
3. How d)i she first hint that she wanted a record player? 

Prediction groups, after reading through what is identified above as the initiadng event of Episode 1 
were asked these questions: 

1. What do you think Delilah might want for her birthday? 
Z What do you think Delilah could do to let her parents know wliat she wants for 
her birthday? 

The basal reader teacher's manual suggested asking these four questions about the part of the story 
described above: 

t What birthday is Delilah celebrating? How do you know? Read the sentence 

that gives you a due. 
Z How would you describe the way Delilah looks? 

3. How does Delilah try to get her message across to her parents without telling them? 

4. Do you think her father understood her hint? Why or v^y not? 

Notice that the review groups make one important mfereacc and paraphrase two pieces of central 
explicitly stated information in answer to their questions. The prediction groups' questions engage 
them in predicting, before they read it, the information that the review groups paraphrase after 
reading. The group asked basal reader questions, m addition to one important inferential question 
(number 4 above), are asked one question vAiosc answer vs a literal detail (number 1), one v^ose 
answer actually may distract them from central story information by focu^ on extraneous 
information outs: je of the information depicted in the story map (number 2), and one rather cryptic 
question that skirts around but evades the important implied idea that what Delilah wants is a record 
player (number 3). 

The number of questions per session for the experimental groups was held to a maximum of 9 or 10 to 
allow adequate time for discussion. Because responses to the basal reader questions generally took 
less time, 15 or 16 questions per session were piannel Basal manual questions were not res^ewed by 
the experimenter until after experimental que5:^/:ons (and test questions for lesson comprehension 
measures) were prepared. 
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Measures 

Stoiy tests. All test materials iwere prepared by the eiq)erinenter. Children recalled and answered 
probe questions about three instructional stories spaced throughout the study (called lesson 
comprehension measures in this study) and about pretest and transfer stories selected and mapped 
according to the same criteria used to select and map the instnictional stories* 

For the pretest and transfer stories, oral free and probed recalls were collected after the students read 
the story silently with an examiner present Students were allowed to ask for word pronundations 
while reading, hit they read independently and did not discuss these stories* For three instructional 
stories-those read on the 4th, 8th and 12th day of instrucdon-students oralfy retold and answered 
probe questions about the story on the day after instruction* 

For all five oral free recalls (the three lesson comprehension measures, the pretest, and the transfer 
task), students retold the story to one of four or five adult examinees* To encourage students to fpvc 
complete free recalls, bduding inferences, they were asked to tell the story into a tape recorder so that 
a first or second grader who had not read the story would be able to understand even the hard parts of 
the stor^' after listenmg to their tape. Further attempts to elicit inferences u^duded prompting the 
students once to tell more after they had finished their recall, and, in a manner similar to that used by 
Hemey, Bridge, and Cerr? (1978-79), prompting with up tr two general questions that ^^ed students 
to tell more about literal information they had reported but not made inferences about 

Probe recalls for each of the tested storjes (three instructional stories, the pretest and the transfer 
story) consisted of 15 questions* Five questions tapped important literal story information, five 
required important text<onnecting or slot-filling inferences, and five (called thematic/story exte^ ^on 
questions in this study) went beyond the text^s story line in some way by asking about Uie stor/s theme 
or message, children's evaluattocs of certam characters, or alternative story outcomes. Students had to 
rccombine text information and make judgment j i elated to it to ansvt'er these questions. Altbou^ this 
study was concerned directly with the more text-based aspects cf comprehension, it w important to 
know whether variations in text-based discussions would affea more divergent responses such as the 
ones tapped with these thematic/story extension questions. 

For example, for the story The Birthday,** a literal probe question was, **What was Delilah's problem in 
letting her parents know what she wanted for her birthday?" An inferential probe was, '*What vm the 
real reason that Delilah told her parents about how sou*^^*' comes out of a record player at dinner one 
night?" A thematic/story extension question was, "Why do you think Delilah's parents gave her a 
puppy instead of a record player for her birthday?" 

AlTective response measure. A possible corollary effect of the experimental treatments was assessed 
v^th an affective response measure. Students' affective responses to the stories, which it was believed 
might be more strong and positive in the prediction conditiot^ were measured u^ng a story affect 
questionnaire with the format of and most of the same questions as a questionnwe used by Jose and 
Brewer (1984) with children* Students responded to 10 questions such as "How much did you like this 
story?" or "How mteresting did you think this story was?" by diecking one of seven bax£ arranged from 
very small ("a little") to very large ("a lot"). This measure, which took only a few minutes to complete, 
was collected for each c . the five test stories. 

Procedures 

Lessons. The experimenter; ar experienced dassroom reading teacher, conducted all group lessons. 
Every day, the procedure wa. the same. All groups had the same short vocabulary/background 
knowledge introduction of only a very few words or concepts whose imderstanding was central to the 
story. 
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Students in the basal reader control group then read the story or each alent readbg unit (depending on 
ttfe teachers' manual directions) for the purpose stated m the teachers* manual For mstance, for the 
story *The Birthday/ the purpose for reading the ^ole story was, The title gives us a good idea of 
^t the story may be about Read to find out ^Aai the ^1 wants for her birthday and i^iat happens 
on that day* Pay spedal attciition to the way shr lets her parents know vibat gift she wants and think 
about what you would do if you were this ^L" 

Each experimental groups in contrast, had a global strategy-related reading purpose that was the same 
each day* The strategy*related purpose for each g^oup matched that group's c^qierimental 
manipidation. On the first day 6( instruction, the es^rimecter briefty described bow stories do not 
ahvays tell the reader everything, so the reader has to think during the ^oie time that she or he is 
reading. Re^ew groups were told to tamk about how all the pieces of the story fit together with each 
other and about ^y the characters do the things they do* In addition to Uiat, the re^new-plus-justify 
groups were told to think about yibat information they used to fill in the missing p^xes or to figure out 
how the pieces of the story fit together-they m^ use things they already knew in their lives, things 
they already knew about stories, and things they had already read in the story* Hie strat^related 
purpose for prediction groups was to use what th^ already knew and idiat they had alrea^ read to 
keep tr^ng to figuife out what would happen next in the story* Fre£ct-phis-ju^fy groups also were 
told to think about ^fikat information they used to make their predictions, and to compare thdr 
predictions with vibdi actually happened in the story after more reading. 

These discussions took less than 5 minutes on the first day of instruction* After that, at the start of 
each lesson the experimenter asked children to recall what they had been doing every day in their 
reading lessons. The experimenter repealed salient points from the children's responses and added 
points they omitted* 

Silent reading and discussion in basal reader groups followed a format typical for small-group lessons* 
After students had read a section of the story Gently, several questions were asked* For each one, the 
experimenter asked the question, duldren bid for a turn to answer by rai^ng hands, and the 
experimenter selected a respondent When the respondent's answer was correct or plausible, the 
experimenter said lUght" and unless another student volunteered to say something else, the 
experimenter went on to the next question. Multiple responses were not sougjht actively* When an 
answer was incorrect or implausible, the question was asked again and again until a correct response 
was ^ven. Respondents were not asked to explain their answers unless the teacher's manual 
specifically directed the teacher to do so. For example, a basal reader question about "The Birthday* 
was, "How did Delilah feel about her new puppy? ' Any plausible answer was accepted without a 
request for explanation because the teacher's manual did not direct the teacher to ask anything like, 
"How could y^M tell?" 

In the experimental groups, in contrast, multiple responses were sought actively* For every question 
accompanying a silent reading unit, Uie experimenter asked the question, gave children time to 
mentally frame an answer, then called on one respondent (a record was kept so all students were asked 
for an initial response an appronmately equal number of times). In the review groups, without judpng 
the first answer, the experimenter then asked if anyone wanted to say anything more or anything 
different* The experimenter tried to stay out of the role of answer evaluator by gjmng group members 
a chance to decide whether answers were implausible or incomplete and by hdping students to see that 
two different answers could sometimes be "right." Occasionally the experimenter had to push for a 
plausible answer when no one in the group disagreed with an implausible one* 

In the prediction groups, all students were encouraged to commit themselves to a prediction* In the 
predict-plus-justify groups, students also explained how they formed their predictions, and, after ftuther 
reading, compared their predictions to the author's choice for how to continue the story* 
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Scoring fk«e itcdb. To score duldren's free recalls, a proportional representation of each story was 
produced and compared to the stor/s map to identify each important literal, unimportant Gteral, and 
important tmpBed proportion. Tlien each diikl*s free recall was matched to this propositional 
representation. Procedures are described in det:^! below. 

The story mzp representatira of eadi st(»y was used as the baas for free recall scorii^ dedsons. 
First, eadh story was divided into chuses, each ofi^dudi counted as o^ Additional^, 
eadi new {uece of tnfonnati(Mi about the time, place, or main characters of the story the setting 
information) counted as a i^poation, even if it did not com[vise as Thus, 
m "The Birthday," for examine, the dause "Delilah Bush is almost 10 years old" counted as two 
propos&ions, not one, because that clause introduced a main diaracter for the first time ("Delilah 
Bush") and estal^shed a settii^ detsul that is related to the central event sequence of the story (is 
almost 10 years dd"). 

Once aU stated story propositicms were so listed, important sIot*fiIIing and text-connectiiig inferences— 
those that filled in misang cat^ories of sXory information or misang links between cat^ories of 
information-were ad^ to the proportional representatioiL For example, the idea "Delilah wants a 
record player" was added to the list prcqioaticms, even thou^ it was imj^ied and not stated m the 
story, because it explicates vdiat the story map identified as her goal. 

Finally, stated story [MropositicHis were clasdfied as "important" or "unimportant" uang the foOomig 
scheme: Any pr(^x)dtion that contained new story category information was counted as important, 
other information was unimportant 

The propositional representation of the above excerpt from "The Birthday* will be used to clarify how 
these decisions were made. 

G16 At dinner that night she dropped a hint. 

017 "We^re studying how sound works," she said. 

018 "We learned how you get sound out of a record player. 

019 It's very, very interesting." 

020 (Because she wants them to know she is mterested in record players.) 

021 "HowT her father asked 

022 Delilah told him. 

023 "Yotf re right," he said. 

024 "That's very, very interesting." 

025 (He doesn't seem to get the hint.) 

Important and cT^Iidtness decisions were as follows: 

016 and 018 are literal and important, because each explains part of Delilah's first plan. 

017 and 019 are literal and unimportant, because they embellish the plan, but add no new information. 

020 is implied tnd important, because it explicates the connection between Delilah's plan and her goal 

021 and 022 are literal and unimportant, because they add no new information. 

023 and 024 are literal. Either one is important, because each partially explains the result of this plan. 
Because the important idea in these propositions is redundant, only one per free recall is counted as 
important If both are present, the other counts as unimportant 

025 is implied and important, because it further explains the result of this plan and suggests vdiy 
Delilah will have to come up wiih another plan. 




Fiddii^ ^uferimi, & Pearson 



Discusaon Questions • 12 



This method of representing story informaticm was decided upon because it r^resents «mp(»rtant 
implied ideas as weU ^ Ctcral ernes, and it differentiates impo^ 
stin jHTOvidii^ a medianism ^ving duldrra some cre^ 

To matdi a duld^s recaD to the {^opositional representatioa oi the story, the child's recall was dhdded 
into units that represented as many separate pr(^)ositicns the story as possible^ and any elaborations 
onthest(»y. For exami4e» one ddld's recaD of the stcxy segment represented as prc^K^^ 
above was the fdlowing: 

1 And what she wanted for her Urthday was a recml player. 

2 And the first hint she gave them was at the dmner table. 

3 ShesaidthatsheMbeeastodyingsoundmsdiool 

4 and that she... thou^ the sound was pretty 

5 and that ste'd like a radio maybe-I mean a record player. 

This part of the recall was scored in the fdlowing way: 

1 was matdied to an ea^erpropoddcm. Oil, and counted as 

2 was matched to 01^ and counted as important literal. 

3 was matdied to 017 and counted as lOTw^por^ 

4 was counted as wwnportant impUed. It is an elaboration that neither 

advances nor interferes inth stoiy comprehenaon. 

5 was counted as inconect infonnadon'-T>^V3a3x did not tell her parents she 

wanted a recced player; she onfy hinted it 

In addition to important Uteml, tuUmportant literal, important implied, wdmportant impBed, and inconect 
information, a diild's recall could include several other types of information* A description and an 
example of each from the story The Birthday* is ^n below. 

Subsuming Statement any induwe statement tiiat subsumes two or more propositions. 
Example: She gave her parents hints about four times. 

Eaqplanation: This child inferred a common feature of the four plan sequences in the 
story-each is a hint to Delilah's parents. For the major analyses, these were added to 
important inferences. 

Evaluative/Judgmental Comment: The child ffvcs his opinion about the quality of the story or about a 
character or event 

Examples: It was a good story. 

The ending was dumb. 

She should have told them she wanted a record player. 

Evdluadve/pidgnental statements were so infrequent that they were not conddered 
Atfther in any analyses. 

Thus, four categories of free recall were of spedal intf-rest: important literal unimportant literal, 
important inference, and elaboradve inference. Incorrect information was kept track of for separate 
con^deration but was not examined in any majcMr anafyses. Eadi chQd received a score in each 
category that summed the number of unprompted propositions he recalled with the new {vopodtions 
he added after the prompts he was g^n during his oral free recall 
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The o^rimciier scored alt free recaC protocob. A randomly selected 10% d tbe i^ocols from 
eack st(»y vrat vescored by a graduate student nuyoring in reading* after the sc:inD{; system was 
^2i2uned to her. Interrater reliability for each of the stories on the four major rcca)^ categories 
important literal, unimp(xtant literal^ important inference, elaborative inference) ranged from M to 
J89. 

Scoring probed maUs. Answers to fiteral questicms were secured as cmect (1) or mcorrect (0). 
Answf)rs to inferential and thematic/stoiy extension questicms were scored as plau^Ie (1) or 
m]dauaUe(0)* Partial credit could be gjven if a qoesticm asked f<^ answer justification 
did not sup[^ it For example, the question *^at land ctfg^ is Del^ How can you tell?* was 
awarded 1/2 p«nt if the cluld o&red a p!ausible deso^ticm ctf ^ 

did not, upon prompting; teO nAy she thot^ so* Occasionally, diit<^'s answers rqvesented 
alternative stoiy interpretations. liidiridual dedaons were made about the plausitrility of these 
interpretations* Proportion correct out 5 Tor literal, inferential and thematic/st<Mry extendcm 
questions and total proportion correct out of IS questicms were computed 

Theocaminer scored aQftfobed recalls, and one of three graduate stude^ Initial 
interrater refiatnlities migsd bom *87 to AO scoring discrepancies were resolved throu^ 
discussion between the oqperimenter and the other sccmr. 

Handling of missing data. Although OHupIete data was available on the standardized reading test and 
was obtained throu^ makeup testing i^en necessary for lesson comprehenson and transfer measures, 
children sometimes were absent for instruction on a stoiy and therefcKe could not be tested on it 
These duldren, in qnte of generalfy good attendance, would have been eliminated from the repeated 
measures analyses (wluch reqtnre complete data on the repeated measur^ if thdr missing data were 
notfilledin. Eliminating 20 chfldren from this stu(fy^pty because they missed one day of i 
was not acceptable; therefcKe, steps were taken to fill m misang data ^th the best posable estimate of 
what the diild's scores would have been if he or she had been present fc^ instruction and taken the 
lesson comprehendon tests. 

I^riefly, separate r^esaon equations predicting performance on each instructional story were 
calculated for the students m each group for whom complete data were available. These equaticms 
used all available data-the school, the standardized reading test total reading percentile, the total 
mean score on the story pretest, and the total mean score on the other two instructicMial stories beades 
the one v^ose score was being predicted Once these equations were computed, they were used m 
predicting mdividual students' missing values. 

Group means for each question type and recall type, as well as total mean scores, were compared for 
only the children v»th complete data and for tne total group mcluding any filled*m data. Because 
differences were negli^le, only the data m which estimated values have been substituted for missing 
data are reported throughout tUs study. 

Results 

Each of the four main anafyses described below-lesson comprehension free recall, lesson 
comprehension probed recall, transfer free recall, and transfer probed recall-used a mixed des^ with 
one between-subjects factor, one or two v^thin-subjects factors, and three covariates. All analyses were 
performed using tiie MANOVA program in tiie SPSS-PC-^ package (Nomas, 1986a, 198(Sb). 

The between-subjects portion of each analysis was ca d out m the same way, so it vrill be described 
here only once. First the covariates, then treatment group contrasts, and finally covariate-by*treatment 
interactions were entered School district was entered first m an attempt to amtrol for differences 
between districts that were not of mterest m this study-mainly, the different s t andardized reading tests 
used. Total reading percentile from the district's standardized reading test was entered next, foDowed 
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bjr the diQd'.s Vy-A score from the appropriate story pretest measure (oral free recall 'it oral probed 
recaOy dependbg m ifae dependent measure in the analysis). Because thes? pretest measures are of 
general interest tliroughout the anafyses, group means on them are reported separately in Table 3. 

[Insert lUUe 3 abool here.] 

Four orthogonal contrist^ reiuresenting hypothedzed treatment groi^ differences were entered into the 
between-sufcjectsanafyias after the three covariates. Cratrast 1 (the story map contrast) compared the 
basal reader group wUh all four e]qperimenf.al groups to determine the relative effects <^ basal reader 
and story niap-derTveddiscossio&quesdon& Onitrast 2 (the jusdficadon contrast) measured the effects 
of answer justification comparing the two no^jusdficadon groi^ 

groups. Contrast 3 (the qoesticm focus contrast) measured the relative effects of prediction and review 
questions by ccHnparir the two i^ed]cti;m groups i^th the two review groups. Contrast 4 assessed the 
justification-by-questH.ii focus interaction to determine if the relative effect of justifying answers was 
mediated by whether prediction or roioew questions wim asked 

The three covariate*by-treatffient interactions were entered into the between-subgects part of the 
anafyaslast-sdiod by treatment, total reading by treatment, and story pretest None of 

these interactions was significart in any analysis^ so interj^etation wQl focus on the treatment group 
contrasts controlled for the covariates. 

The witlun-subjects part of each analysis varied slightfy^ so each one wiQ be described in detaO v^en it 
is reported When appropriate^ tests of simple main effects or post hoc comparisons followed the 
overall anafyses. 

Tests of hraiogenity of errc^ variance were carried out routinely in the SPSS-PC -¥ NfANOVA 
program. Although m the lesson comprehen^on measure anafyses some subscores violated the 
univariate homogeneity of error variance assumptions, the ori^nal mixed analyses were carried out 
nonetheless fot a more complete picture of the results. The between-subjects part of each anafyns, 
upon which the major interpretations are based, uses i^iat amounts to group grand means, which did 
not violate the assumptions. Nor were homogeneity of error variance assumf^ons violated in the 
anafyses of transfer effects. 

Because the treatment group contrasts are orthogonal, the significance of each can be examined 
separately even if the treatment effect is not significant overall Since group differences are the nuun 
focus of interest in this stu^, the separate treatment group contrasts instead of the overall treatment 
effect are reported in the between-subjects ANOVA summaries* However, because there were no 
significant separate treatment contrast*by*covariate interactions and just one significant treatment 
contrast-by-within subject factor interaction that is described elsewhere, only the overall mteractions 
involving treatment are reported in the ANOVA summary tables for economy of presentation. 

Lesson Comprehensioii Measures Analyses 

Free recalls. The ANOVA summary table for the overall analysis of free recall lesson comprehen^on 
measures is shown in Table 4. Because there were no interactions between the treatment contrasts and 
the within-subjects part of the design, group treatment effects are interpreted directfy. The treatment 
group means presented in Table 5 represent the mean total number of recalled proportions (important 
literal + unimportant literal + important inferential + elaborative inferential) collapsed across the 
three stories. 

[Insert Tables 4 & 5 about here.] 

Of the four orthogonal contrasts for treatment, only Contrast 4» the justification-by-Iesson focus 
interaction, is significant {F{ifi6) - 6.54, p - X)l)« incUcating that the effect of justi^ng answers was 
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different in the ^ediction and review groups. Post hoc comparisons of the two prediction groups and 
the two review groups indicated that vriiile answer justificadon led to significantly..better performance 
in the predict-i^-justify group than the predict-onfy group (difference in means = SJ» p<«OS), the 
means of the two review groups were much closer (difference in mean;. - 13) and sli^itfy, thou^ 
nonsignificant^, £avcmd the no-jusdficaticn group* Possibly there was mote (tf a press for plausiUlity 
of predicticHis smd resuldng attention to text ideas in the {Mredict-plus-justify group than in the predict* 
ooty group, whereas the general focus on inference-making in the review groups led to deeper 
procesang of text ideas in both review groups, even without a spedal focus on answer justification. 
These results are interpreted further in the discussion. 

Although the main focus oi this study is on treatment effects, results from the within-sutqects part of 
the des^ are presented fcHT a more detailed incturectfANOVA findings. Thewithm-subjectsanafyas 
indnded two rqieated measures factors-one for story (Story 1, Story 2, Story 3) and one for recall type 
^portant fiteral, ununportant literal, important inferential, elaixMrative inferential). The reader is 
referred again to Table 4 for a summary of the within^sutgects ANOVA results. 

The significant recall type-by-story mteraction (F(6,606) = 172.47,p < .001) indicates that the relative 
difference in recall type mean scores depends on the story. However, because the same bade trend is 
evident m eadi st(Nry, the separate cell means are not reported here. The agnificant main effect for 
recall type (F(33Q3) 714JB2^p < «001) and the pattern^^ recall type scores summed across the three 
stories shows that important literal information is recalled more tlum ar^ other type (important literal- 
165, unimportant literal-22, important inferential-3.0, elaborative inferential-2^). Since there was 
more important Uteral information to recall than any other type, this is a completely ei^pected result 

Probed recalls. Table 6 shows the ANOVA summary table for the overall anafysis ot {urobed recall 
lesson comprehension measures, and Table 7 shows observed means, means adjusted for the 
covariates, and standard deviations for eadi question type within each stoiy. Tix within-subjects part 
of the design included two repeated measures factors-one for question type (UteraL inferential, 
thematic/story extension) and one for story (Stocy 1, Story 2, Story 3). The significant treatment-by- 
question type-by-story interaction (F(16,404) = L82, p = .026) indicates that group effects depend on 
certain combinations of question type and story. Interpretation, then, will focus on this interaction. 
Although it could have been examined in several ways, it was the group differences that were of 
primary interest, so the a priori treatment group contrasts were tested for significance for each 
separate combination of story and question type. So trends of these results can be observed more 
easily, the results of these contrasts are presented in Table 8. 

[Insert Tables 6, 7, & 8 about here.] 

The first notable result is that for literal probes in the first two stories but not the third, the four 
experimental groups (whose story discussions centered on story map-derived questions) performed on 
average better than the basal group (Contrast 1). In Story 3, the one story vdiere this effect was not 
observed, an examination of means shows high performance for all groups on the literal probe 
questions (range of adjusted means = .80-.89). There is some trend, then, toward better performance 
from the experimental groups than tH basal group on literal questions. Esrolanation of this expected 
result is straightforward. Any time tl.t^ experimental groups were asked literal questions during story 
discussions, the questions highlighted important information: moreover, all probed recall questions that 
were literal hi^dighted important information. In conUast, althougih the proportion of literal 
discussion questions in the basal reader discussion groups was high, the focus jie questions was not 
consistently on important information. 

The second notable result, consistent v^th the overall results of the free rtM:all analysis, is again an 
indication that justification of answers is differentially important in review'' and prediction groups 
(Contrast 4). Here, the effect is evident in performance on inferential prol"? questions, v^ere the 
justification-by-question focus interaction was significant in two stories and close to significant (p - 
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,08) in the UiinL A closer examination of this interaction mdicated that answer justification led to 
significantly better performance m the prediction treatments (difference m adja«ted mean proportion 
correct for inference probes across all three stories - .193; F(l,86) - 18.42, /> ^ .000), the means of 
the two review groups on inferential probes were not significantly dUferent (within SA of each other on 
every story). Apparently the emphaas on infereaitial questions m the review groups was sufficient to 
engage the readeis in deeper procesang <tf the text ideas without the added empha^ on answer 
justification and vqrificatkHL After all, to gwe plausible answers to inferential questions that are m 
some way text dependent, <Hie must interact vnth the text information* It is pos^Ie, in contrast, that 
the nature of the discusdons in the prediction-onfy group actuaify fostered departure bom the text 
ideas and hence a tenden^ to discount these ideas m inference-making. This possibility will be 
e3q>lored further in the discusdon. 

The third notable trend m these results is that all significant and ncar-rignificani effects are confined to 
literal and inferential questicms. There is no indication of groiq> differences on thematic/story 
extension questions, AlthoQ^ it had been hypothesized that a focus on important ideas and on making 
inferences also no^t result in better perfcHmance on these more divergent questions (e.g., "^Vhat do 

you tlunk the point of ttiis story is?" *What kind of person would you say is?", eta), this 

does not appear to be the case. 

One exception occurred, thougih, with the subset of these probes that asked for a new story ending or 
an alternative action for the prota^nist Because this sort of question was asked r^ularfy at the end 
of story discussions in t>oth prediction treatments, it was of interest to know )K^ether there were group 
differences on this subset of probe questions* Hve of the thematic/story extension questions across the 
three lesson comprehension measures fit this description-e.g.. Tick one of the animals Anand the 
spider captured. Tell another way you think he could have captureo^. and wi^" or "What do you think 
Delilah will do a couple of weeks before her next birthday? Why?" or "Do you think Stu^ will ever do 
his homework m invisible ink ag^? Why/Why not?" When group means were examined on just these 
five responses across the tfiree instructed stories, it was found that the same general trend that was 
apparent m other parts of the dabt appeared here as well: The predict-plus-justify group performed 
better than all other groups, and the predict-onfy and basal groups were lowest m the rank ordering 
(predict plus justify-.TS, review plus justify- Jl, review-.TO, basal-.64, predict-.64). 

Trends* Although these free and probed recall lesson comprehension measure anafyses were directed 
by the a priori treatment contrasts, examination of treatment group means reveals other consent 
trends that support the original hypotheses with some modifications. Most important, m some cases it 
was the une3q)ectedly low performance of the predict-onfy group that kept the experimental groups' 
performance from stifpasdng that of the basal reader control group. When the predict-onfy group is 
not considered, the other three experimental groups' average performance is significantly better than 
the basal control group's performance on literal and inferential probes across all stories (literal: basal- 
.72,othcrs-,82,F(136) = 12.4,p < .001; inferential: basal-.65,otiiers-J4,F(l,86) = 6.45,p = .013). 

Furthermore, v^en the focus is put on the most stable measures-general results collapsed across all 
stories and types of free or probed recall-a general pattern emerges m the rank ordering of groups, 
with the predict-plus-justify group outperformmg all others, the two review groups performing nearly 
the same and next m the rank ordering, and the basal and predict-only groups performing similarly and 
the lowest* Tins trend is evident in the rank ordering of mean proportion correct on probed recalls 
aaoss ^11 stories (predict plus justify-.75, review + justify-.73, review-.72, basal-.66, predict-.64) and 
the rank ordering of mean number of propositions recalled across all stories (predict plus justify-27.9, 
review-2S.9, review plus justify-245, basal-233, predict-22,2). It should be noted that these same 
rank orderings were not evident on the pretest measures. These irends are consistent ^th the general 
expectations set forth m the original hypotheses, once the depressed performance of the predict-onfy 
group is taken into account 
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Transfer Measures Analyses 

Free recall. Table 9 shows the ANOVA summary table for the overall analysis of the free recall 
transfer measure, and Table 10 lists treatment group adjusted and observed means and standard 
deviations for each free recall type. In the within-subjects part of the design, there was one repeated 
measures fkctor-*recall type O^mpo^^tant literal, unimportant literal, important inferential, elaborativc 
inferential). It can be seen that the onfy significant effect in the anafysis, aside from the covariates, is 
the significant effect for recall type (F(3303) - 39Z9, p - .000). As in the lesson comprehension 
measures free recall anafysis, this effect is directly interpretable and not at all surprisuig. Students 
dearty recalled more important literal information than any other type, but again, there was more of 
this information to recall than any other type. As Table 10 shows, the overall pattern of group 
differences, although not significant, follows a trend similar to the one noted tkro^gjhout the lesson 
comprehension measures analyses-the predict-plus-justify group outperformed other groups overall 
Nevertheless, this anal^ of the free recall transfer task does not suggest that children in any of the 
experimental groups picked up any ^neralizable routines in the 12rday instructional period 

[Insert Tables 9 & 10 about here.] 

Probed recall. Table 11 shows the ANOVA summary table and Table 12 the pattern of adjusted and 
observed means for the transfer probed recall task. There was one repeated measures' factor in the 
within-subjects part of the de^gn-question type (literal, inferential, thematic/story extension). The 
only significant result was a significant overall effect for question type (F(2,2Q2) = 16.04, p = .000). 
Neither of the planned contrasts among question types-literal versus inferential or thematic versus the 
other two-was significant, however. Again, there is no evidence uf a transfer of improved performance 
from an instructional to an mdependent reading situation in this analysis. 

[Insert Tables 11 & 12 about here.] 

Discussion 

The most consistent finding of this study is the mediating effect that answer justification has in the case 
of prediction. In inference probe questions, in literal probes for one instructed story, and in overall 
free recall of instructed stories, the predict-plus-justify group performed significantly better than the 
predict-only group. Furthermore, \^en all five groups are rank-ordered by thdr performance on each 
outcome measure, the predict-plus-justify group nearly always ranks at the top, ^^e the predict-only 
group is nearly always the lowest, or higher than only the basal group. The most compelling 
explanation for this discrepancy in performance between the two prediction groups is that although 
both were expected to engage in ueep processing because of a consent emphasis on forward- 
inferendng, the predict-only group's inferences may not have been suffidentfy constrained by the text. 
The press for multiple responses to the prediction questions, although it was intended to increase 
reader involvement and inference making, inadvertently may have encouraged departure from the text 
in the predict-only group. Faced with the request to tell ^lat might happen next in a story, and 
unhampered by the constraint of having to tell how they arrived at their predictions, some children may 
have decided diat it was better to come up with a new prediction instead of agreeing with one made by 
someone else, in spite of the experimenter's explanation to the children that it was '^OK to agree with 
someone else when I ask you what you think is going to happen in the story.** 

Early m both phases of the study, the biggest problem in both prediction groups had been the 
children's overconcem with being **righr in their predictions. Although stories were typed so that only 
one silent reading unit appeared on a page, children in the prediction groups were seen surreptitiously 
flipping ahead in the story, or pressing the current page down as ilat as possible so they could read 
through to the next page, just so they could make the **righr prediction. In an effort to eradicate this 
over-concern with being right, the experimenter may have inadvertentiy pushed the balance too far in 
the other direction in telling the children, **Being rigfit Isn't the main tlung. Thinking about the story 
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hardleiiough to make a p«ediction of vibait you tiiink will happen is the main thing.** Once correctness 
was no longer ^e major concern, one of the most conunon responses to the question, ''And what do 
you think is gcnng to happen?" was, ''Well, he took mme!''-as though a prediction was mvalidated by 
having been ma^ already someone else m the group. 

Althougih an cdiaustive anal^ of the relationship between the content of prediction groups' 
discussions and their free recalls has not been made, there is some evidence that vibcn predictions were 
not confibmed or refiit^d after further reading; they sometimes showed up as "incorrect information" in 
children^ recalls. In the story The Birthday," for example, in ^ch Delilah is surprised with a puppy 
for her tnrthclay even though she hinted for, and thought she was going to get, a record player, severed 
children m eadi of the predict-only groups, but not m the other groups, "remembered" that she got a 
record player, ot a puppy a record player. Similarly, m another mstrucdonal story upon which 
lesson comprehendon measures were obtsdned, the stor/s structure primes children for thinking that 
the main, character, Stuey, will have done his homework m invisible ink the night before he actually 
does. Although this misconception was common in all groups before ifiscussion, perhaps only in the 
predict-onty groups did it go uncorrected. 

It had been expected that one of the factors that w6uld heighten prediction groups' performance was 
heightened engagement with the text and, thus, hdghtened affect The expectation of heightened story 
affect in the pre^ction groups was disconfirmed by results from anatyses of the affective response 
measures. Mean scores for a subset of six responses (the ones that measured suspense, excitement, 
surprise, interest, outcome-lildng and story-liking) did not differ significantly among groups (Story 1- 
range = 4.7-53, p-=. .729; Story 2-range = 4.1-5.1,/? = .560; Story 3-range = 3.7-5.1,p « .237), and 
the prediction groups were not always at the top of the range. Interesting^, ^en an independent rater 
listened to the tape recordings of the group lessons for the second story upon vMcti lesson 
comprehension measures were obtained ("The Birthday"), she identified the two prediction groups as 
having the most lively mvolvement in the lesson in eadh phase of the stucfy. Apparently, it is not 
involvement alone that mcreases memory for the story-rather, it may be focused engagement vnlh 
text-related ideas. Predicting outcomes, justifying predictions, and confirming or refuting them upon 
further reading may be effective because it is in effect a ^^le comprehension-monitoring package in 
which the engagement with the text is slightly different, and more focused, at each step. Moreover, the 
focus.of prediction on important or central text ideas in this study means that those ideas were the ones 
getting the increased cognitive attention in the predict-plus-justify group. 

The depressed performance of the predict-only group in this study is at odds with the findings of 
Anderson and his associates (Anderson et £d.» 19S7; \^^ilkinson et al., 1987), but it should be 
remembered that here, the test of prediction is much more stringent, as prediction is compared vnth 
other meaning-emphasis as opposed to word-level-emphasis conuitions. 

Justifying one's answers did not have the same mediating effect on perfonnance of the review groups. 
Review and review-plus-justify groups performed nearly identically on many outcome measures, and 
neither was con^tentfy higher than the other m cases where performance of the two groups differed. 
It had been expected that answer justification would provide unique opportunities for increased 
interaction with t^ ideas, clearing up misconceptions, and hearing the reasoning of others in the 
review-plus-justify condition. The nature of actual group interactions suggests, however, that the 
review-only groups had the same oQportunities, but self-initiated them only as the need arose. 

First, a high proportion of the review groups* discussion questions emphasized mference-making, so 
that text ideas akeady were bemg processed deeply. Inaeased mteraction with the text ideas through 
justifying one's answers may have been just ihat^creased interaction, not necessary or better 
mteraction* Second, recall that m review groups, more 'iian one respondent was called on and group 
members were encouraged to commit themselves to dA mtcrpretation ^en there was disagreement. 
The consistent press for multiple responses in the review-onfy groups as well as the review-plus^justify* 
groups actualfy may have provided them with the chance for answer justification v^en it was most 
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needed*«if^en there was disagreement about an answer. Tape recordings of review group discussions 
suggest that children often spontaneous^ justified thdr answers when they were disagreeing with 
someone else. So the review-only groups in fact may have been practidng a more economical form of 
answer justification and ''making thinking piiblic^-they did it vAicn the need arose naturally, out of lack 
of agreement on an answer or confusion about text ideas* 

The expectation that experimental groups ^f^ose story discussions focused on important and implied 
text ideas would outperform a basal reader control group was modestly upheld in this study. Recall 
that on two of the three lesson comprehension measures, performance on literal prob^ questions was 
significantly higher in o^rimental groups than in the basal control group; and that if the predict^cnly 
group was excluded from con^deration, the effect extended to inferential probes and to the third lesson 
comprehendon measure as well The rank*ordering of means on tLc free recall lesson comprehension 
measures also indicates some advantage for all story map groups except the predict-only group. 

Although literal information actually was Uie focus of more of the basal group's discusdon questions 
than the esqperimental groups' questions ^ . ct, the two prediction groups were asked no literal 
questions at all), there was no systematic focus in the basal group questions on yAat was of central 
importance in the story. T^ , questions such as ''What tnrthday was DelHah celebr^ing?" "What did 
Delilah's parents buy in t\. .ousewares Department?" and "How would you describe jDelilah's looks?" 
(for the story The Birthday") proliferated in the basal story distussicMis, ^ilthou^ knowing this 
informatbn would not enhance performance on a test ^ose questions had been deseed with a 
combined focus on important and implied text ideas* Discussion questions m the esqperimental groups, 
whether literal or inferential, recused on vibat was of central importance. Althou^ probed recall 
questions did not duplicate any of the questions asked during experimental discus^ons, the same theory 
motivated the construction of both, and many of the same text ideas were tapped* This focus on 
important text ideas in story map-based group discussions also may have emphasized for these groups a 
set of important ideas around which to anchor their free recalls, vA^c the basal group was left with a 
less systematically selected set of text ideas to use as anchor points. 

The failure to find significant transfer effects was disappointing. It was encouraging, however^ that the 
same general trends were evident for transfer free recalls and probed recalls as in the lesson 
comprehension measures analyses. There is some evidence in the tape-recorded lessons, in fact, that 
the experimental group routines may have taken some time to be learned, and that a longer study 
might have led to significant transfer effects. The special difiBculties of the predict-only groups in 
learning the prediction strategy ahready have been noted* Similar^, early in the predict-plus-justify and 
review-plus-justify groups, the experimenter's request for a reason for one's answer may have been 
interpreted frequently as a hint that an answer was wrong and should be changed* The following 
example ocoured in a review-plus-justify group in the first week: 

T: And why did the monkey tell the crocodile he left his heart on the riverbank? 

(pause) What do you think? Eric? 
E: Well, that was a trick on the crocodile. 
T: And vdiat makes you say that, Eric? 
E: ... I changed my mind. 

T: No, Fm not saying you're wrong. I just wondered how you figured out your answer. 

A more general suggestion of the time it may have taken to learn the new reading routines comes from 
the short strategy-related purpose-for-reading discussions at the tK^nning of each eT^rimental 
session. In the early lessons, children were likely to focus ou their behavior in the small-grouo lessons 
when asked what they were supposed to be doing in their reading groups every day* One uoid in a 
predict-pius-justify group, for example, responded, "Well, we're supposed to sit up straight, be quiet * . . 
and not look ahead in the story!" (The experimenter had reminded the children how important it was 
to listen to each other's ideas; apparentiy this was interpreted as "Be quiet!") By the second week of 
the study, there was a more general tendency at least to make an appropriate response to the strat^- 



Fieldingp Andcrscm, & Pearson 



Discussion Questions • 20 



related purpose question. Interesdngly^ in the third week, there were even several hints of application: 
A duld, again in a predict*plus-justify group, responded, like vAen we read the one about the invi^Ie 
ink, we tried to figure out vAm he would do to make it (his homework) come back.** Another child, 
this time in a review-plus-justify group, remarked that she thought it was fun to tlunk like this and was 
trying it out on the stories she read at home. 

Cole and Griffen (1986), in fact, argue faom an educational perspective that language mediates 
cognitive functimt Perhaps children have to learn how to talk about new ways of thinking before they 
can learn to do them consistent^, and in a longer study more measurable treatment and transfer 
effects might be eWdent as duldren become more proficient as group participants. 

There are several limitations in this study. First, practical constramts on as^gnment of children to 
groups meant that the asagnment procedure was not trufy random. Second, there is reason to believe 
that measurement error may have affected the results of both the lesson comr^ ^hendon measure 
anafyses and the transfer measure analyses in the ways detailed below, so that the true differences 
among ^oups must be larger than shown in this study. 

First, groups ^ered initially in their abilities to perform the criterion tasks, ^^^spedally the fi:ee recall 
task, in spite of the investigator^s best attempts at random as^gnmeni to groiips. Mean number of 
story proportions recaScd on the pretest ranged firom a low o! 16.4 in the predict^^nly group to a high 
of 253 in the basal group. B^use such large group differences existeo before the intervention, it is 
likely that some of the variance in performance on the lesson comprehendon measures that was 
attributed to treatment effects might Imve been due to students' initial abilities, even after group means 
were adjusted for the covariates. It is possible, the thi^t the basal group in particular would have had 
an undue advantage, and the predict-only and re\new groups an undue disadvantage, in the statistical 
analyses performed m this study. This possibiiity was tested by assuming a range of pretest reliabilities 
other ihm perfect reliability and studymg whii the rc^t^ts of the same analyses might have been if 
measurement error were taken into account. To do this^ the correlations between pretest performance 
and each other variable in the analysis were corrected for attenuation (Lord & Novick, 1968) assuming 
reliabilities of .70, .80, and .90 instead of 1.0, the analyses were rerun using these corrected correlations, 
and the pattern of estimated res'jlts was examined. 

For the lesson comprehension measure analyses, these corrections for attenuation resulted in stronger 
observed effects of the story map-based discussions. In the hypothetical case of pretest reliabilities of 
.8 and below, the story map versus basal contrast significantly &vored the story map groups in both free 
and probed recall performance. The net effect for justifying answers slso was strengthened; 
nevertheless, justification of answers still was especially important in the prediction condition. 

Measurement error may have affected the results of the transfer analyses in an additional way. While 
three lesson comprehension measures were collected for each child in the stu^, only one traasfer 
measure was collected. The lesson comprehension measure is thus, in effect, three times as long as the 
transfer measure and so can be assumed to be more reliable. One could ask how results would differ if 
a more reliabb transfer measure (le., performance on more than one transfer story) were available. 
Again, instead of assuming perfect reliability, a range of transfer measure reliabilities was hypotherized 
(.70, .80, and .90), correlations between the transfer measure and all variables in each analy^ vicrc 
corrected for attenuation, and the ori^al analyses were rerun. It was found that in the hypothetical 
case of criterion measure reliabilities of .80 or less, v^en corrections for attenuation were applied to 
the free and probed recall transfer measure analyses, the effect was to magnify the mediating effect of 
answer justification in the prediction concfition. Furthermore, thf^ trend was for the story map effect to 
carry over to independent reading. For a hypothesized reliability of .70, ^he story map contrast 
significantly favored the story map groups for free recalls, and the same trend was present (although 
significance was not reached) for hypothesized reliabilities of .80 and .90. 



Fieldingi Andersooi & Pearson 



Discussion Questions - 21 



It should be empluidzcd» of course, that tfiese results do no more than suggest ^fAtX mgftt have been 
found under aOual conditions of initial equality of treatment groups and more reliable criterion 
measurement These conditions, however, did not exist If this study were to be replicated, several 
modifications such as true randcnn asugnment to treatment groups and use of several transfer 
measures instead (tf just one would certainly be warranted 

Several further explorations of these data migiht offer a more compk c picture of exactly v^ may be 
affecting (either podtively or adversely) chOdren*s ways of thinking about stories. For example, recent 
investigations of classroom participation structures (Au & Mason, 1961; Bloome & Green, 1984; 
Cazden, 1966; Green, Barker, & Golden, 1967; Weber, 1966) suggest that how children learn to thuik 
about what they read may be as much a function <tf hoW they are allowed to talk ^Mth the teacher and 
with one another, and how much they are allowed to initiate the questions and topics of discusdon, as it 
is a function of the cognitive demands <^ teacher*po6ed questions. DiUon (1962, 1983) cautions that 
teachers' questions could do as much to constrain duldren's thuddng as they do to promote higher 
intellectual fimctiomng. In the present stu<fy, althou^ diiUren's questions and comments were 
allowed, the story discus^ns were driven by teadier*select6d and teadier*posed questions and 
teacher-set rules for req;>ondIcg. Tape-recorded lessons from Hus s^udly could be anafyzed to make 
comparisons among gr ^ m such things as the amount and land of teacher talk versus student talk 
and the i&ddence of stc it-initiated questions or comments, because these posdS^e differences may 
have influenced children's memory for stories m some way. S^ematic anafyses of the content of group 
discus^ons in this stwfy, and of how the spedfic content of discus^ns showed up in or affected free 
and probed recalls, also have not been conducted and may be warranted Microanalyses 
Wilkinson et al., 1987) may be appropriate to e}q)lore further the extent to v^ch unconfirmed 
predictions in particular may have affected story memory. 

An examination of this stud/s results also suggests several directions for future research that m^^y offer 
a more dear picture of how teachers' discusdon questions affect the model of meaning that children 
construct for a text For example, m the present study, students' thematic interpretations did not differ 
among groups (there were no group differences in performance on thematic/stoiy extendon questions 
and few evaluative statements m free recalls). Whether other types of teadier-posed discusdon 
questions or other patterns of teacher-student and student-student interaction would promote these 
high-level responses is of future mterest. Additionally, it undoubted^ is true that real, naturally written 
trade books for children offer far greater variety and compledty, with fev^r of the constraints in length, 
vocabulary, and topic than those operating on the basal reader stories in this study. Elementary school 
teachers' discusdons ^^th children of naturally occurring trade books provides an important and almost 
^^de-open avenue for further research (eg., Walmdey & Walp, in press). 

In any case, the present stuuv offers important suggestions about the effect that teachers' questions can 
have on the model of meaning that children construct for a text The dearest su^estion is that if 
teachers want to ask prediction questions about stories, they should make sure to ask children for 
reasons behind their predictions and provide time to monitor predictions after further reading. The 
stu^ also suggests that, whether th^ ask prediction or review questions, teachers will do well to base 
their questions on text information that is important and that must be inferred Such questions invite 
dose attention to the text and integration of text information mUx prior knovrfedge. These forms of 
text processing are more desirable than processing that is unconstrained by the text (predict only) or 
constrained by nonccntral points in the text (basal). 



24 



Fieldinfr Andersod, & Pearson 



Discusaon Questions • 22 



References 

Adams, M« J*, & Collins, A. (1979)* A schcma-theojredc of rea^ng. In R« 0« Frecdle (Ed), New 
directions in discourse processing VoL IhAdwmces in discourse processes (pp, 1-22), Norwood, NJ: 
Ablex. 

Anderson, 4^ C, & Pearson, P« D. (1984). A schema-theoretic view of ba^c processes in reading 
comprehension. In?. D.VcBiSQn(]E4.)jH(mdbook of rtiuiingrtseimA New York: 

Longman* 

Anderson, R. C, Wilkinson, I., Mason, J., & Shirey, L. (1987, December). Prediction versus word4€vel 
questions. Paper presented at the 37th meeting of the National Reading Conference, St 
Petersburg Beach, FU 

Au, K. H., & Mason, J. (1981)« Sodal organizational factors in learning to read: The balance of rights 
hypothec Reading Research Quarterfy, 17, 115-152. 

Beck, L McKeown, M. &, McCaslin, E S., & Burkes, A« M. (1979). Instmctionat dimensions that 
rmy affect reading comprehension: Examples fiom two commercial reading prog/tons. Pittsbuigh, 
PA: University of Pittsburgh Learning Research and Development Center. 

Beck, L L, Omanson, R. C, & McKeown, M. G. (1982). An instructional redesign of reading lessons: 
Effects on comprehension* Reading Research Quarterly. 17, 462-481. 

Bloome, D., & Green, J. (1984). Directions in the sodolinguistic study of reading* In P. D. Pearson 
(E(L), Handbook of Reading Research (pp. 395-421). New York: Longman. 

Bruce, B. (1980a). Analysis of interacting plans as a guide of the understanding of story structure. 
Poetics, 9,795-311. 

Bruce, B. (1980b). PlauS and sodal actions. In R. J. Sinro, B. C. Bruce, & W. F. Brewer (Eds.), 
Theoretical issues in reading comprehension (pp. 367-384). Hillsdale, NJ: Eribaum. 

Bruce, B, (1984). A new pomt of view on childretfs stories. In R* C. Anderson, J. Osbom, & R. J. 
Tiemqr (Eds.), Learning to read in American schools: Basal readers and content texts (pp. 153- 
174). Hillsdale, NJ:ErIbaum. 

Bruce* B., & Newman, D. (1978). Interacting plans. Cognitive Science, 2, 195-233. 

Cazden, C. (1986). Classroom discourse In M. C. Wittrock (Ed.), Handbook of research on teaching 
(3rd ed., pp. 432-462). New York: Macmillan. 

Cole, M., & Griffen, P. (1986). A sodohistorical approach to remediation. In S. deCastell, A. Luke, & 
K Egan (Eds.), Literacy, society, and schooling: A reader (pp. 110-131). Cambridge, MA: 
Cambridge University Press. 

Collins, A., Brown, J. S., & Larkin, K. M. (1980). Inference in text understanding. In R. Spiro, B. 
Bruce, & W. F. Brewer (Eds.), Theoretical issues in reading comprehension (pp. 385-407). 
Hillsdale, NJ: Erlbaum. 

Craik, F. I., & Lockhart, R. S. (1972). Levck of processing: A framwork for memory research. 
Journal of Verbal Learning and Verbal Behavior, 11, 671-684. 



25 



Fiddiogy AndersoOt & Pearson 



L>iscussion Questions • 23 



Dillon, J. T. (1982). The cfTect of questions m education and other enterprises. Journal of QtnicuUm 
Studies, H 127-151 

Dillon, J. T. (1963). Teadting and the art of questioning (FasKback Series No. ir^). Bloomington, IN: 
PMDelU Kappa. 

Durkin, D. (1978-79). What classroom observations reveal about readmg comprehension instruction* 
Reaa^igRujearch Quarterfy, 14, 481-533. 

Durkin, D. (1981). Reading comprehen^on instruction in five basal reading series* ReofUng Research 
Quarterly, 16, 515-544. 

Fiti^erald, J. (1984). The relationship between reading ability and e^^Kxtations for story structures. 
Discourse Processes, 7, 21-41. 

Fitzgerald/Whaley, J. (1981). Readers* e3Q)ectat:ons for story structure. Reading Research Quarterly, 
i7, 90-114. 

Fitzgerald, J., & Spiegel, D. L. (1983). Enhancing children's reading comprehendon through 
iastructiou in narrative structure. Journal of Reading Behavior, 15{2), 1-17. 

Glo'.'er, J. A*, Bruning, R. H., & Flake, B. S. (1982). Distinctiveness of encoding and recall of text 
materials. Journal of Educational Psychology, 7^,522-534. 

Glover, J. Flake, B. S., Roberts, B*, Zimmer, J. W. & Pahnere, M* (1981). Distinctiveness of 
encoding: The effects of paraphrasing and drawing inferences on memory for prose. Journal of 
Educational Psychology, 73^ 736-744. 

Gkivcr, J. A., Flake, B. S., & Zimmer, J. W. (1982). Distinctiveness of encoding and memory for 
learning tasks, '^'iumal of Educational Psychology, 74, 189-198. 

Gordon, C J., & Pearson, P. D. (1983). The ejects of instruction in metacomprehension and inferencing 
on children's comprehension abilities (Tech. Rep. No. 277). Urbana-Champaign: University of 
Illinois, Center for the Study of Reading. 

Green, J. U, Barker, J. O., & Golden, J. M. (1987). Lesson construction: Differing views. In G. W. 
Noblit & W. T. Pink (Eds.), Schooling in social cmtext: Qualitadve studies (pp. 4v.' -77). Norwood, 
NJ:Ablex. 

Guszak, F. (1967). Teacher questioning and reading. The Reading Teacher, 21, 228-234. 

Hansen^ J. (1981). llic effects of inference training and practice on young children's reading 
comprehension. Reading Research Quarterly, 76,391-417. 

Hansen, J., & Pearson, P. D. (1983). An instructional study: Improving the inferential comprehension 
of good and poor fourth-grade readers. Journal of Educational Psychology, 75, 821-829. 

Hart, C. (1977). The birthday. In E. Evertts & B. Weiss (Eds.), Holt Basic Reading System: Level 12^ 
Special Happenings (pp. T77-T88 teacher's edition). New York: Holt Rinehart & V/mston> 

Idol, L. (198'/V Group story mapping: A comprehension strategy for both skilled and unskilled readers. 
Journal of teaming Disabilities, 20, 196-205. 



Fielding; Anderson, & Pearson 



Discussion Questions - 24 



Jacoby, L. Craik, & Begg, L (1979). Effects of elaboration of processing on encoding and 
retrieval: Trace distinctiveness and recovery of initial context Journal of Verbal Learning and 
Verbal Behavior, 18, 585*600. 

Jose, P. "E^ & Brewer, W. F. (1984). The development of story lildng: Character identification, 
suspense, and outcome resolution* Developmental Psychology, 20y 911-924. 

Lord, F. M., & Novick, M . R. (1968). Statistical theories of mental test scores. Menlo Park, CA: 
Addison-Wesley. 

Mason, J., & Au, K. (1986). Reading instmction for today. Glenview, IL: Scott, Foresman. 

Mason, J., & Osbom, J. (1982). When do children begn 'Yeading to team?**: A survey of classroom 
reading instmction practices in pades two throuf^ five (Tech. Rep. No. 261). Urbana-Champaign: 
University of Illinois, Center for the Study of Reading. 

Morrison, T. (1986). Question types and fates of student responses in second and fourth grade basal 
reading instmction. Unpublished doctoral dissertation. University of Illinois, Uibana-Champaign. 

I^icholas, D. W., & Trabasso, T. (1980). Toward a taxonomy of inferences for story comprehension. In 
F. Wilkening, J. Becker, & T. Trabasso (Eds.). Information integration by children (pp. 243-265). 
Hillsdale, NJ: Erlbaum. 

Norusis, M. J. (1986a). Advanced statistics SPSSPC^ forOte IBM PV/XT/AT. Chicago, IL: SPSS, Inc. 

Norusis, M. J. (1986b). SPSS/PC-^ for tite IBM PC/XT/AT. Chicago, IL: SPSS, Inc. 

Omanson, R. C. (1982). An analysis of narratives: Identifying central, supportive, and distracting 
content. Discourse Processes, 5, 195-224. 

Omanson, R. C, Beck, I. L., Voss, J. F., & McKeown, M. G. (1984). The effects of reading lessons on 
comprehension: A processing description. Cogiition and Instmction, 1, 45-67. 

Omanson, R. C, Warren, W. H., & Trabasso, T. (1978). Goals, inferential comprehension, and recall 
of stories by children. Discourse Processes, 1,337-354. 

Palmcsar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and 
comprehension-monitoring actiwties. Cofftition arui Instmction, i, 117-175. 

Paris, S. G., & Lindaeur, B. K. (1976). The role of inference m children's comprehension and memory 
for sentences. Cogititive Psychology, 8, 217-227. 

Pearson, P. D., Hansen, J., & Gordon, C. (1979). The effect of background knowledge on young 
children's comprehension of explicit and implicit information. Journal of Reading Behavior, U, 
201-209. 

Pearson, P. D., & Johnson, D. (1978). Teaching reading compreltcusion. New York: Holt Rmehart & 
Winston. 

Raphael, T«, & McKinney, J. (1983). An exammation of fifth- and eighth-grade children's question- 
answering behavion An instructional study in metaccgnition. Journal of Rea^ng behavior, 15(3), 
67-86. 



Fielding, Anderscm, & Pearson 



Discussion Questions • 25 



Raphael, & Pearson, P. D. (1985). Increa^ students' awareness of sources of information for 
answering questions. American Educational Research Journal, 22, 217-236* 

Raphael, & Wonnacott, C A. (1985)* Heightening fourth-grade students' sensitivity to sources of 
information for answering comprehen^on questicMis. ReaiBng Research Qiuarteriy, 20^ 282-296. 

Redfield, D* & Rousseau, E. W. (1981). A meta-analysis <rf eq>erimental research on teacher 
questioning behavior. Review of Educational Research, 51, 23?-245. 

Rumelhart, D. (1977)* Understanding and summarizing brief stories. In D* LaBergc & S* J* Samuels 
(Eds.), Basic processes in reading: Fercepdm and comprehension (pp. 26S-3Q3). Hillsdale, NJ: 
ErlbauuL 

Rumelhart, D. (1980). Schemata: The building blocks (rf cogniticxL In R. J. Sinro, B. C Bruce, & W. F. 
Brewer (Eds.), Theoretical issuts in reading conymhension (pp. 33-58). HiOsdale, NJ: Eribaum. 

Singer, H., & Donlan, D. (1982). Active comprehenscm: Problem-sclving schema with quesdcm 
generation for comprehension of complex short stories. Readmg Research Quarterfy, 17, 166-186. 

Simtb,F.(i97S). Comprehension and learning. New Y(^ Holt Rinehart&lX^nstcm. 

Stauffer, R. G. (1975). Directing the reading^hirtkingimKess. New Yoric Harper & Row. 

Stein, N. L., & Glenn, C. (1979). An analyas of story comprehenaon in elementary school children. In 
R. O. Freedle (Ed.), New Erections in discot^rse processing VoL U: Ad\wices in discourse 
processes (pp. 53-120). Norwood, NJ: Ablex. 

Sundbye, N. (1987). Text explidtness and mferential questioning: Effects on st(xy understanding and 
recall Reading Research Quarteriy, 22, 82-98. 

Hemey, R. J., Bridge, C, & C^rra, M. J. (1978-79). The discourse procesdng operaticms oi children. 
Reading Research Quarterfy, 14, 539-573. 

Trabasso, T., & Nidiolas, D. W. (1980). Memory and inferences in the comprehenaon of narratives. 
In F. Wilkening, J. Becker, & T. Trabasso (Eds.), Information integration by children (pp. 215- 
242). Hillsdale, NJ: Eribaum. 

Trabasso, T., Secco, T., & Van Den Broek, P. (1984). Causal echelon and story coherence. In H. 
Mandl, N. L. Stein, & T. Trabasso (Eds.), Learning and comprehension of text (pp. 83-111). 
Hillsdale, NJ: Eribaum. 

Walmsley, S., & Walp, T. (in press). Toward an integrated language arts curriculuis: Philosophy, 
practice and implications. Elementary School Journal. 

Warren, W. H., Nicholas, D. W., & Trabasso, T. (1979). Event chains and inferences in understanding 
narratives. In R. O. Freedle (Ed.), Nen directions in discourse processing Vol H: Advances in 
discourse processes (pp. 23-52). Norwood, NJ: Ablex. 

Weber, R. (1986, April). The constraints of the questioning routine in reading lessons. Paper presented 
at the annual meeting of the American Educational Research Association, San Francisco, CA. 

Wilkinson, I., Anderson, R. C, & VSTilson, P. T. (1987, December). Prediction and the modeling of group 
dynamics. Paper presented at the 37th meeting of the National Reading Conference, St 
Petersburg Beach, FL. 



28 



Fidduig, Anderson, & Pearson Discussion Questions * 26 

Authors' Notes 

This report is baseu on the first author's disscrtadon, which was completed at the Univerdty of Ubois 
at Urbana-Cbampaigit She grateful^ ackno^edges the asastance of her dissertation co^hairs 
Richard Andersm and P. Da^d Pearson, dissertation committee member Robert Hemey, and Jana 
Mason for theur advice and assistance. 

The first autb<^ wishes to thank the 1985-86 prindpals, third-grade teachers, and thtrd-grade students 
of Kenwood Sdiod in Champaign, niincHS, and Bri^iam and Sugar Creek Schools in Normal, DlincMs, 
for their participation f 1 this study. 



29 



Fieldtiig» Anderson, & Pearson 
Table 1 

Planned Differences Among Groups 
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Group 


Source of 
Questions 


Ireaiction 
vs. Review 


Justification vs. 
No Justification 


1 


Basal 






2 


Story map 


Review 


No justification 


3 


Story map 


Prediction 


No justification 


4 


Story map 


Review 


Justification 


5 


Story map 


Prediction 


Justification 



30 
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Table 2 

Group Descriptive Statistics 
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Group 


Phase 




Total Reading Percentile^ 
M SD 


IrliaSal 


1 




49 


27 




Z 


Q 
O 


67 


27 




Total 


20 


JO 


Z/ 




1 


in 


52 


27 




2 


12 


69 


18 




Total 


22 


61 


24 


3-Prcdict 


1 


12 


53 


25 




2 


12 


68 


24 




Total 


24 


60 


25 


4-Review+ Justify 


1 


13 


51 


30 




2 


8 


67 


30 




Total 


21 


57 


30 


5-Prcdict+Justify 


1 


11 


53 


25 




2 


8 


68 


22 




Total 


19 


59 


25 



^Phase 1 test = SRA Achievement Series, 3.1 norms, ^en 9/8S. 

Phase 2 test = Stanford Achievement Series, Primary 2 Form E, 3.1 norms, ^ven 9/85. 
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Tables 

Stoiy Pretest Means and Standard Deviations (SD) by Group 



Group Basal Review Predict Review Predict 

+ Justify + Justify 

n 20 22 24 21 19 



Total 

Free 253 18.8 16.4 16.8 20.7 

Recall (13.1) (102) (112) (102) (9.7) 

Total 

Probed .67 .58 .63 .58 .68 

Recall (28) (.20) (26) (.28) (.25) 
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Table 4 



ANOVA For Free RecaSI Lesson Comprehension Measures With Two Repeated 
Measures 



Source of 


cc 






r 


n 

r 


Variation 












Between 












ocnooi 


AO (\A 




48.94 


1.0/ 


.zuu 


Total Rdng. %tile 


1418.29 


} 


14J8.29 


4838 


.000* 


Pretest Tot. Recall 


1883.42 




1883.42 


6425 


000* 


Contrast 1^ 


30.75 




30.75 


IjQS 


309 


Contrast 2 


73.51 


J 


73.51 


151 


.117 


Contrasts 


2.55 




2.55 


j09 


.769 


contrast 4 


lyi.oo 




101 iCiC 

lyi.oo 




•Olx 


Treat X School 


5.10 


4 


127 


j04 


.9% 


Treat. X Tot. Rdng. 


2127 




532 


.18 


.947 


I reat. x iretest 








OA 

.oU 


.DO I 


Residual 


2521.08 


86 


2931 






▼viinin 












Recall Type 


44795.86 


3 


14931.95 


714.82 


.000* 


A iCal. A XxCCcUl 1 YP^ 








1 10 




Residual 


6329.42 


303 


20.89 






Story 


939.77 


2 


469.88 


35.75 


.000* 


Treat. X Story 


141.85 


8 


17.73 


135 


.221 


Residual 


2654.92 


202 


13.14 






Recall Type X Story 


7642.12 


6 


1273.69 


172.47 


.000* 


Treat, x Rec. Type x Story 


236.97 


24 


9.87 


134 


,131 


Residual 


4475.21 


606 


738 







Contrast 1: Story map 

Contrast 2: Justification 

Contrast 3: Question focus (review vs. predict) 

Contrast 4: Justiflcation by question focus 
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Tables 

Mean Total Free Recall Across All Stories by Group 



Group 


Basal 


Review 


Predict 


Review + 
Justify 


Predict + 
Justify 


M 












Adjusted 


23.4 


25.8 


222 


24.5 


27.9 


Unadjusted 


24.0 


253 


20.7 


233 


28.6 


(SD) 


11.8 


9.1 


9.1 


lU 


10.9 
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Table 6 

ANOVA For Probed Recall Interim Measures With Tivo Repeated Measures 



Source of 


SS 


df 


MS 


F 


P 


Variation 










Between 












School 


.44 




.44 


3.73 


.056 


Total Rdng. %tile 


6.02 


\ 


6.Q2 


51.00 


.000* 


Pretest Total 


3.69 






3L27 


.000* 


Contrast 1 


39 




29 


2.43 


.^23 


Contrast 2 


.74 


\ 


.74 


625 


.014* 


Contrast 3 


.18 




.18 


1.49 


.225 


Treatment x School 


.81 




.20 


1.72 


.155 


Treat. X Tot. Rdng. 


31 




.08 


.66 


.628 


Treat. X Pretest 


35 


4 


.14 


tl6 


332 


Residual 


10.16 


86 


.118 






Within 












Question type 


3.91 


2 


195 


54.02 


.000* 


Treat. xQ. type 


.65 


8 


j08 


2.24 


.026* 


Residual 


7.31 


202 


.036 






Story 


.08 


2 


.04 


.91 


.406 


Treat. X Story 


.33 


8 


.04 


.94 


.486 


Residual 


8.88 


202 


.044 






-Q. type X Story 


3.12 


4 


.78 


30.62 


.000* 


Treat x Q. type x Story 


.74 


16 


.05 


1.82 


.026* 


Residual 


10.28 


404 


.025 







Adjusted and Observed 7 aans and Standard Deviations (SD) for Lesson Compreliension Probed 
Recall Question lypes 



Thematic/ Total 
Gtoap literal Inferential Story Extension Probed Recall 



Stoiyl 




obs. 


(SD) 


adj. 


obs. 


(SD) 


adj. 


obs. 


(SD) 


adj. 


obs. 


(SD) 


Basal 


jSI 


62 


(.28) 


.75 


.75 


(27) 


.60 


.60 


(28) 


.65 


.66 


(25) 


Re^ew 


.70 


.69 


(.16) 


.78 


.78 


(24) 


.62 


.61 


(28) 


.70 


.69 


(20) 


Predict 


.61 


62 


(.14) 


.66 


.66 


(25) 


i7 


38 


(22) 


.61 


.62 


(.18) 


Review + 
Justify 


.74 


.72 


(.20) 


.78 


.76 


(27) 


.62 


.60 


(.19) 


.72 


.71 


(.16) 


Predict + 
Justify 


.77 


.78 


(.22) 


.84 


.86 


(.23) 


.66 


.68 


(.22) 


.76 


.77 


(.18) 


Stoiy 1 
Total 




.68 


(.21) 




.76 


(25) 




.61 


(24) 




.68 


(.24) 


Stoiy 2 


























Basal 


.69 


.69 


(.27) 


.56 


.56 


(.27) 


.61 


.68 


(.27) 


.65 


.65 


(.21) 


Review 


.83 


.83 


(.14) 


.70 


.69 


(.24) 


.63 


.63 


(.22) 


.72 


.72 


(.15) 


Predict 


.81 


.82 


(.17) 


.48 


.48 


(.15) 


.70 


.70 


(.27) 


.66 


.67 


(.14) 


Review + 
Justify 


.84 


.82 


(.21) 


.71 


.69 


(.24) 


.76 


.75 


(.24) 


.77 


.75 


(.19) 
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Thematic/ Total 
Group Literal Inferential Story Exten^on Probed Recall 



Story 2 


adj. 


obs. 


iSD) 


adj. 


obs. 


(SD) 


adj. 


obs. 


(SD) 


adj. 


obs. 


m 


IVcdict + 
Jusdiy 


.92 


.92 


(.11) 


.66 


.67 


(.17) 


.67 


.68 


(22) 


.75 


.76 


(.11) 


Stoiy2 
Total 




.82 


m 




.62 


(23) 




.69 


(24) 




.71 


(22) 


Stoiy3 


























Basal 


.84 


.85 


(.14) 


.64 


.66 


(29) 


57 


58 


(32) 


j69 


.69 


(21) 


Review 


.89 


.88 


(.11) 


.74 


.72 


(26) 


.58 


57 


(20) 


.74 


.73 


(.15) 


Predict 


.81 


.82 


(23) 


.58 


.59 


(29) 


54 


54 


(25) 


j6S 


.65 


(22) 


Review + 
Justify 


.87 


.84 


(22) 


.70 


.67 


(27) 


34 


52 


(30) 


.70 


.68 


(23) 


Predict + 
Justify 


.80 


.82 


(.19) 


.81 


.83 


(.19) 


.65 


.67 


(21) 


.75 


.77 




Story 3 
Total 




.84 


(.18) 




.69 


(.25) 




.65 


(25) 




.71 


(24) 
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Tables 

Group DifTerences For Each Combination of Stoiy and Question Type 



Contrast 


1 




2 




3 




4 






Basal vs. 
Others 


Justify vs. 
No Justify 


Review vs. 
Predict 


"nteraction 
(C2xC3) 


Story 1 


F* 


P 


F 


P 


F 


P 


F 


P 


literal 


ML 


m* 




.011* 


.71 


.403 


i.28 


.134 


Inferential 


.10 


.755 


3.85 


.053 


.40 


530 


3.21 


.076 


Thcmativy 
Story Ext. 


.14 


.713 


.95 


333 


jOO 


.961 


.97 


328 


Stoiy2 


















Literal 


12.29 


m* 


2.27 


.135 


.69 


.409 


1.48 


.227 


Inferential 


2.49 


.118 




.026* 


iLQ2 


m* 




.(HQ* 


Thematic/ 
Storv Ext. 


jOI 


.921 


1.04 


311 


j04 


JB36 


2.31 


.131 


story 3 


















Literal 


.00 


.990 




.680 


3.83 


.0j5 


.01 


.932 


Inferential 


1.49 


.•225 


337 


.070 


32 


571 


155 


.QQ7* 


Thematic/ 
Story Ext. 


JO 


.952 


.43 


313 


.40 


S2S 


2.01 


.159 



*CriticalF(5.86) = 6.98 for;? = .01 
Critical /■(5,86) = 3.96 for /> = .05 
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Table 9 



ANOVA For Free Recall Transfer Measure 



Source 
of Variation 


55 


4r 


MS 


F 


P 














School 


23429 


1 


23429 


6.71 


.011* 


Total Reading %tile 


1978.91 


J 


1978.91 


56.65 


.000* 


Pretest Total 


1359.44 




1359.44 


38.91 


000* 


Contrast 1 


3147 




31.47 


90 




Contrast 2 


.85 




.85 


.02 


.877 


Contrast 3 


10 


J 


10 


00 


958 


Contrast 4 


106.29 


1 


106.29 


3.04 


.085 


Treatment x School 


110.95 


4 


27.74 


.79 


.432 


Treat. X Tot. Rdng. 


13630 




34.07 


.98 


.425 


Treat. X Pretest 


Thlh 




18.43 


.53 


.716 


Residual 


3004.40 


86 








Within 












Recall Type 


32771.08 


3 


10923.70 


392.90 


.000* 


Treat. xRec. Type 


270.97 


12 


22.58 


.81 


.638 


Residual 


8424.13 


303 


27.8 
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Table 10 

Adjusted and Observed Means and Standard Deviations (SD) For Transfer Free 
Recall 



Group Basal Review Predict Review + Predict + 

Justify Justify 



Important 
Literal 



adj. 


729 


762 


22.8 


23.6 


25.1 


• 

obs. 


25.1 


26.4 


2L7 


2L9 


25.7 


SD 


(ILO) 


(8.6) 


(11-8) 


(1L9) 


(115) 


Unimportant 












Literal 












adj. 


A2 


5.6 


4.4 


4.1 


5.8 


ohs. 


4.8 


55 


4.0 


3.7 


5.9 


cn 


(3-2) 


(3-2) 


(33) 


(3.0) 


(4.9) 


Important 












Inferential 












adj. 


2& 


33 


3.8 


33 


3.4 


ohs. 


3.1 


33 


3.7 


3.1 


3J 


SD 


(23) 


{22) 


(2.6) 


(2.5) 


(17) 


Elaborative 












Inferential 












adj. 


3.3 


3.0 


18 


3jO 


4.4 


obs. 


35 


3.0 


16 


r 


4.4 


SD 


(2.1) 


(2.1) 


(2.0) 


(15) 


(33) 


Overall 














333 


38.0 


33.7 


34.0 


38.7 




36.5 


382 


32.0 


31.5 


39.5 


SD 


(162) 


(12.5) 


(16.6) 


(17.4) 


(18.7) 
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Table 11 

ANOVA For Probed Recall Transfer Measure 



Source 
(tfVariatioa 


55 


4r 


MS 


F 


P 


Between 












School 






.69 


5.95 


.017* 


Total Reading %tile 


5.17 




5.17 


44.57 


.001* 


Pretest Total 


Z89 




289 


2451 


001* 


Ccmtrastl 


jO 




JO 


.0 




Contrast2 


JOl 


\ 


.01 


.11 


.728 


Contrasts 


M 




.01 


.11 


.735 


Contrast 4 


28 


1 


.28 


244 


.122 


Treatment x Sdiool 


JSi 


4 


.16 


136 


.257 


Treat X Tot Rdng. 


.41 




.10 


.88 


.482 


Treat X Pretest 


.44 




.11 


.94 


.448 


Reddual 


10.02 


86 


.116 






Within 












Question Type 


.77 


2 


3.85 


16.04 


.000* 


Treat x Ques. 


.14 


8 


.017 


.74 


.652 


Residual 


4.76 


202 


.024 
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Table 12 

Adjusted and Observed Means and Standard Deviations (SD) For Transfer Probed 
Recall 



Group 


Basal 


Rewew 


Predict 


Review + 
Justify 


Predict + 
Justify 


Literal 












adj. 


.78 


.83 


.79 


.83 


.8-7 


cbs. 


.78 


.83 


.80 


.80 


.90 


SD 


(31) 


(.25) 


(•25) 


(31) 


(-21) 


Inferential 












adj. 


.76 


.81 


JES 


.70 


.79 


ote. 


.77 


.80 


j69 


.6' 


.82 


SD 


(32) 


(25) 


(.30) 


(.28) 


(.21) 


Thematic/ 












Story Extension 


' 1 


T, ■ r- - i 








adj. 


.71 


.72 ■ 


.«7 


.68 


.72 


obs* 


.72 


.71 




.65 


.74 


SD 


(35) 


(.26) 


(32) 


(34) 


(•28) 


Total 












adj. 


.75 


.79 


.71 


.74 


.79 


ohs. 


.76 


.78 


.72 


.71 


.82 


SD 


f30) 


(.22) 


(•27) 


(-28) 


(.20) 
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